Adjusting display settings of a head-mounted display

ABSTRACT

Apparatuses, methods, systems, and program products are disclosed for adjusting display settings of a head-mounted display. An apparatus includes a processor and a memory that stores code executable by the processor. The code is executable by the processor to receive sensor data from one or more sensors operably connected to a head mounted display (“HMD”) unit while a user wears the HMD unit. The code is executable by the processor to determine a visual acuity of the user based on the sensor data. The code is executable by the processor to adjust one or more display settings of the HMD unit based on the determined visual acuity for the user. The one or more display settings may be adjusted to correct for impairments in the user&#39;s visual acuity.

FIELD

The subject matter disclosed herein relates to head-mounted displays andmore particularly relates to adjusting the display of head-mounteddisplays based on a user's visual acuity.

BACKGROUND

Displays for head-mounted displays may have various settings that a usercan manually adjust, similar to a display for a smart phone or atelevision. A user that has corrective lenses or contacts, which may notbe able to be worn while wearing the head-mounted display, may not beable to clearly see elements on the display. It can be inconvenient andburdensome for the user to constantly change display settings, if theyare changed at all, to try to correct the user's impaired vision.

BRIEF SUMMARY

An apparatus for adjusting display settings of a head-mounted display isdisclosed. A system and method also perform the functions of theapparatus. In one embodiment, an apparatus includes a processor and amemory that stores code executable by the processor. In certainembodiments, the code is executable by the processor to receive sensordata from one or more sensors operably connected to a head mounteddisplay (“HMD”) unit while a user wears the HMD unit. The code, in someembodiments, is executable by the processor to determine a visual acuityof the user based on the sensor data. In various embodiments, the codeis executable by the processor to adjust one or more display settings ofthe HMD unit based on the determined visual acuity for the user. The oneor more display settings may be adjusted to correct for impairments inthe user's visual acuity.

In one embodiment, a system for adjusting display settings of ahead-mounted display includes a head-mounted display (“HMD”) unitcomprising a processor and a memory that stores code executable by theprocessor, a headband coupled to the HMD unit, and one or more sensorscoupled to the headband and operably connected to the HMD unit. Incertain embodiments, the code is executable by the processor to receivesensor data from one or more sensors operably connected to a headmounted display (“HMD”) unit while a user wears the HMD unit. The code,in some embodiments, is executable by the processor to determine avisual acuity of the user based on the sensor data. In variousembodiments, the code is executable by the processor to adjust one ormore display settings of the HMD unit based on the determined visualacuity for the user. The one or more display settings may be adjusted tocorrect for impairments in the user's visual acuity.

In one embodiment, a method for adjusting display settings of ahead-mounted display includes receiving, by a processor, sensor datafrom one or more sensors operably connected to a head mounted display(“HMD”) unit while a user wears the HMD unit. The method, in furtherembodiments, includes determining a visual acuity of the user based onthe sensor data. The method, in various embodiments, includes adjustingone or more display settings of the HMD unit based on the determinedvisual acuity for the user. The one or more display settings may beadjusted to correct for impairments in the user's visual acuity.

BRIEF DESCRIPTION OF THE DRAWINGS

A more particular description of the embodiments briefly described abovewill be rendered by reference to specific embodiments that areillustrated in the appended drawings. Understanding that these drawingsdepict only some embodiments and are not therefore to be considered tobe limiting of scope, the embodiments will be described and explainedwith additional specificity and detail through the use of theaccompanying drawings, in which:

FIG. 1A is a schematic block diagram illustrating one embodiment of asystem for adjusting display settings of a head-mounted display;

FIG. 1B is a schematic block diagram illustrating one embodiment of amap of electrode placement on a user's head;

FIG. 2 is a schematic block diagram illustrating one embodiment of anapparatus for adjusting display settings of a head-mounted display;

FIG. 3 is a schematic block diagram illustrating one embodiment ofanother apparatus for adjusting display settings of a head-mounteddisplay;

FIG. 4 is a schematic flow chart diagram illustrating one embodiment ofa method for adjusting display settings of a head-mounted display;

FIG. 5 is a schematic flow chart diagram illustrating one embodiment ofanother method for adjusting display settings of a head-mounted display;

FIG. 6 is a schematic flow chart diagram illustrating one embodiment ofa further method for adjusting display settings of a head-mounteddisplay; and

FIG. 7 is a schematic flow chart diagram illustrating one embodiment ofyet another method for adjusting display settings of a head-mounteddisplay.

DETAILED DESCRIPTION

As will be appreciated by one skilled in the art, aspects of theembodiments may be embodied as a system, method or program product.Accordingly, embodiments may take the form of an entirely hardwareembodiment or an embodiment combining software and hardware aspects thatmay all generally be referred to herein as a “circuit,” “module” or“system.” Furthermore, embodiments may take the form of a programproduct embodied in one or more computer readable storage devicesstoring machine readable code, computer readable code, and/or programcode, referred hereafter as code. The storage devices may be tangible,non-transitory, and/or non-transmission. The storage devices may notembody signals. In a certain embodiment, the storage devices only employsignals for accessing code.

Many of the functional units described in this specification have beenlabeled as modules, in order to more particularly emphasize theirimplementation independence. For example, a module may be implemented asa hardware circuit comprising custom VLSI circuits or gate arrays,off-the-shelf semiconductors such as logic chips, transistors, or otherdiscrete components. A module may also be implemented in programmablehardware devices such as field programmable gate arrays, programmablearray logic, programmable logic devices or the like.

Modules may also be implemented in code and/or software for execution byvarious types of processors. An identified module of code may, forinstance, comprise one or more physical or logical blocks of executablecode which may, for instance, be organized as an object, procedure, orfunction. Nevertheless, the executables of an identified module need notbe physically located together, but may comprise disparate instructionsstored in different locations which, when joined logically together,comprise the module and achieve the stated purpose for the module.

Indeed, a module of code may be a single instruction, or manyinstructions, and may even be distributed over several different codesegments, among different programs, and across several memory devices.Similarly, operational data may be identified and illustrated hereinwithin modules, and may be embodied in any suitable form and organizedwithin any suitable type of data structure. The operational data may becollected as a single data set, or may be distributed over differentlocations including over different computer readable storage devices.Where a module or portions of a module are implemented in software, thesoftware portions are stored on one or more computer readable storagedevices.

Any combination of one or more computer readable medium may be utilized.The computer readable medium may be a computer readable storage medium.The computer readable storage medium may be a storage device storing thecode. The storage device may be, for example, but not limited to, anelectronic, magnetic, optical, electromagnetic, infrared, holographic,micromechanical, or semiconductor system, apparatus, or device, or anysuitable combination of the foregoing.

More specific examples (a non-exhaustive list) of the storage devicewould include the following: an electrical connection having one or morewires, a portable computer diskette, a hard disk, a random access memory(RAM), a read-only memory (ROM), an erasable programmable read-onlymemory (EPROM or Flash memory), a portable compact disc read-only memory(CD-ROM), an optical storage device, a magnetic storage device, or anysuitable combination of the foregoing. In the context of this document,a computer readable storage medium may be any tangible medium that cancontain, or store a program for use by or in connection with aninstruction execution system, apparatus, or device.

Code for carrying out operations for embodiments may be written in anycombination of one or more programming languages including an objectoriented programming language such as Python, Ruby, Java, Smalltalk,C++, or the like, and conventional procedural programming languages,such as the “C” programming language, or the like, and/or machinelanguages such as assembly languages. The code may execute entirely onthe user's computer, partly on the user's computer, as a stand-alonesoftware package, partly on the user's computer and partly on a remotecomputer or entirely on the remote computer or server. In the latterscenario, the remote computer may be connected to the user's computerthrough any type of network, including a local area network (LAN) or awide area network (WAN), or the connection may be made to an externalcomputer (for example, through the Internet using an Internet ServiceProvider).

Reference throughout this specification to “one embodiment,” “anembodiment,” or similar language means that a particular feature,structure, or characteristic described in connection with the embodimentis included in at least one embodiment. Thus, appearances of the phrases“in one embodiment,” “in an embodiment,” and similar language throughoutthis specification may, but do not necessarily, all refer to the sameembodiment, but mean “one or more but not all embodiments” unlessexpressly specified otherwise. The terms “including,” “comprising,”“having,” and variations thereof mean “including but not limited to,”unless expressly specified otherwise. An enumerated listing of itemsdoes not imply that any or all of the items are mutually exclusive,unless expressly specified otherwise. The terms “a,” “an,” and “the”also refer to “one or more” unless expressly specified otherwise.

Furthermore, the described features, structures, or characteristics ofthe embodiments may be combined in any suitable manner. In the followingdescription, numerous specific details are provided, such as examples ofprogramming, software modules, user selections, network transactions,database queries, database structures, hardware modules, hardwarecircuits, hardware chips, etc., to provide a thorough understanding ofembodiments. One skilled in the relevant art will recognize, however,that embodiments may be practiced without one or more of the specificdetails, or with other methods, components, materials, and so forth. Inother instances, well-known structures, materials, or operations are notshown or described in detail to avoid obscuring aspects of anembodiment.

Aspects of the embodiments are described below with reference toschematic flowchart diagrams and/or schematic block diagrams of methods,apparatuses, systems, and program products according to embodiments. Itwill be understood that each block of the schematic flowchart diagramsand/or schematic block diagrams, and combinations of blocks in theschematic flowchart diagrams and/or schematic block diagrams, can beimplemented by code. This code may be provided to a processor of ageneral purpose computer, special purpose computer, or otherprogrammable data processing apparatus to produce a machine, such thatthe instructions, which execute via the processor of the computer orother programmable data processing apparatus, create means forimplementing the functions/acts specified in the schematic flowchartdiagrams and/or schematic block diagrams block or blocks.

The code may also be stored in a storage device that can direct acomputer, other programmable data processing apparatus, or other devicesto function in a particular manner, such that the instructions stored inthe storage device produce an article of manufacture includinginstructions which implement the function/act specified in the schematicflowchart diagrams and/or schematic block diagrams block or blocks.

The code may also be loaded onto a computer, other programmable dataprocessing apparatus, or other devices to cause a series of operationalsteps to be performed on the computer, other programmable apparatus orother devices to produce a computer implemented process such that thecode which execute on the computer or other programmable apparatusprovide processes for implementing the functions/acts specified in theflowchart and/or block diagram block or blocks.

The schematic flowchart diagrams and/or schematic block diagrams in theFigures illustrate the architecture, functionality, and operation ofpossible implementations of apparatuses, systems, methods and programproducts according to various embodiments. In this regard, each block inthe schematic flowchart diagrams and/or schematic block diagrams mayrepresent a module, segment, or portion of code, which comprises one ormore executable instructions of the code for implementing the specifiedlogical function(s).

It should also be noted that, in some alternative implementations, thefunctions noted in the block may occur out of the order noted in theFigures. For example, two blocks shown in succession may, in fact, beexecuted substantially concurrently, or the blocks may sometimes beexecuted in the reverse order, depending upon the functionalityinvolved. Other steps and methods may be conceived that are equivalentin function, logic, or effect to one or more blocks, or portionsthereof, of the illustrated Figures.

Although various arrow types and line types may be employed in theflowchart and/or block diagrams, they are understood not to limit thescope of the corresponding embodiments. Indeed, some arrows or otherconnectors may be used to indicate only the logical flow of the depictedembodiment. For instance, an arrow may indicate a waiting or monitoringperiod of unspecified duration between enumerated steps of the depictedembodiment. It will also be noted that each block of the block diagramsand/or flowchart diagrams, and combinations of blocks in the blockdiagrams and/or flowchart diagrams, can be implemented by specialpurpose hardware-based systems that perform the specified functions oracts, or combinations of special purpose hardware and code.

The description of elements in each figure may refer to elements ofproceeding figures. Like numbers refer to like elements in all figures,including alternate embodiments of like elements.

An apparatus for adjusting display settings of a head-mounted display isdisclosed. A system and method also perform the functions of theapparatus. In one embodiment, an apparatus includes a processor and amemory that stores code executable by the processor. In certainembodiments, the code is executable by the processor to receive sensordata from one or more sensors operably connected to a head mounteddisplay (“HMD”) unit while a user wears the HMD unit. The code, in someembodiments, is executable by the processor to determine a visual acuityof the user based on the sensor data. In various embodiments, the codeis executable by the processor to adjust one or more display settings ofthe HMD unit based on the determined visual acuity for the user. The oneor more display settings may be adjusted to correct for impairments inthe user's visual acuity.

In one embodiment, the sensor data is sensed from one or more locationson the user's head. The one or more sensors may be coupled to a headbandthat is connected to the HMD unit. In further embodiments, the sensordata comprises electroencephalography (“EEG”) data sensed from the oneor more locations on the user's head.

In one embodiment, the EEG data comprises a measurement of a signalstrength that the one or more sensors sense within the alpha- andtheta-wave ranges. The user's visual acuity determined according to themeasured signal strength. In certain embodiments, the one or moresensors comprise one or more electrode probes and the one or morelocations on the user's head where the sensors are located is selectedfrom the group consisting of a back of the user's head, O1, O2, and OZlocations.

In various embodiments, the code is further executable by the processorto monitor, over time, the user's visual acuity based on new sensor datafrom the one or more sensors while the user wears the HMD unit andfurther adjust the one or more display settings of the HMD unit based onthe user's visual acuity. In some embodiments, the code is furtherexecutable by the processor to notify the user that the one or moresensors are not positioned in a correct location on the user's head inresponse to not receiving sensor data from one or more of the sensors.

In one embodiment, the code is further executable by the processor togenerate a baseline of sensor data for a period of time after the HMDunit is activated prior to determining the user's visual acuity andadjusting the one or more display settings of the HMD unit. In certainembodiments, the code is further executable by the processor to acquirebiometric data for the user to further determine the user's visualacuity.

In one embodiment, the biometric data biometric data is captured using asensor placed one or more of in and on the user's ear. In someembodiments, the code is executable by the processor to present one ormore of an augmented reality (“AR”) environment and a virtual reality(“VR”) environment on a display of the HMD unit.

In one embodiment, adjusting one or more settings of the HMD unitincludes changing one or more settings of the VR and AR environment. Theone or more settings may be selected from the group consisting of aresolution of the display, a pixel density of the display, a contrastsetting of the display between elements presented on the display and anactual background, a zoom setting, a color setting, and a font setting.

In one embodiment, a system for adjusting display settings of ahead-mounted display includes a head-mounted display (“HMD”) unitcomprising a processor and a memory that stores code executable by theprocessor, a headband coupled to the HMD unit, and one or more sensorscoupled to the headband and operably connected to the HMD unit. Incertain embodiments, the code is executable by the processor to receivesensor data from one or more sensors operably connected to a headmounted display (“HMD”) unit while a user wears the HMD unit. The code,in some embodiments, is executable by the processor to determine avisual acuity of the user based on the sensor data. In variousembodiments, the code is executable by the processor to adjust one ormore display settings of the HMD unit based on the determined visualacuity for the user. The one or more display settings adjusted tocorrect for impairments in the user's visual acuity.

In one embodiment, the one or more sensors comprise one or moreelectrode probes positioned at one or more locations on the user's head.The one or more locations selected from the group consisting of a backof the user's head, O1, O2, and OZ locations. In some embodiments, thesensor data comprises electroencephalography (“EEG”) data sensed fromthe one or more electrode probes located on the user's head.

In one embodiment, the code is executable by the processor to presentone or more of an augmented reality (“AR”) environment and a virtualreality (“VR”) environment on a display of the HMD unit. The one or moresettings of the VR and AR environment that are adjusted may be selectedfrom the group consisting of a resolution of the display, a pixeldensity of the display, a contrast setting of the display betweenelements presented on the display and an actual background, a zoomsetting, a color setting, and a font setting.

In one embodiment, a method for adjusting display settings of ahead-mounted display includes receiving, by a processor, sensor datafrom one or more sensors operably connected to a head mounted display(“HMD”) unit while a user wears the HMD unit. The method, in furtherembodiments, includes determining a visual acuity of the user based onthe sensor data. The method, in various embodiments, includes adjustingone or more display settings of the HMD unit based on the determinedvisual acuity for the user. The one or more display settings may beadjusted to correct for impairments in the user's visual acuity.

In one embodiment, the method includes monitoring, over time, the user'svisual acuity based on new sensor data from the one or more sensorswhile the user wears the HMD unit and further adjusting the one or moredisplay settings of the HMD unit based on the user's visual acuity.

In certain embodiments, the method includes notifying the user that theone or more sensors are not positioned in a correct location on theuser's head in response to not receiving sensor data from one or more ofthe sensors. In one embodiment, the method includes generating abaseline of sensor data for a period of time after the HMD unit isactivated prior to determining the user's visual acuity and adjustingthe one or more display settings of the HMD unit.

FIG. 1 is a schematic block diagram illustrating one embodiment of asystem 100 for adjusting display settings of a head-mounted display. Inone embodiment, the system 100 includes a head mounted display (“HMD”)unit 102. As used herein, an HMD unit 102 may refer to a display devicethat is worn on a user's head and has a display positioned in front ofthe user's eyes. A typical HMD unit 102 has one or two small displays,with lenses and semi-transparent mirrors embedded in eyeglasses (alsotermed data glasses), a visor, or a helmet. An HMD unit 102 may have oneor two (or more) small displays, with lenses and semi-transparentmirrors embedded in eyeglasses (also termed data glasses), a visor, or ahelmet. The displays may be miniaturized and may include cathode raytubes (“CRT”), liquid crystal displays (“LCDs”), liquid crystal onsilicon (“LCos”), or organic light-emitting diodes (“OLED”).

In certain embodiments, the HMD unit 102 may be configured to mount,hold, or otherwise couple to a smart phone, which becomes the computingdevice and display for the HMD unit 102. In such an embodiment, thesmart phone, or other mobile device, may be operably coupled to the HMDunit 102 to enable a user to interact with the smart phone, receive datafrom the HMD unit 102, turn on/off using controls on the HMD unit 102,and/or the like. Otherwise, the display and computing device isintegrated into the HMD unit 102 to form a single unit. The computingdevice may comprise various processors or processor cores, memory,storage, network connectivity chips, graphics chips, audio chips, and/orthe like.

The HMD unit 102 may be configured to present a virtual reality oraugmented reality environment. As used herein, a virtual reality (“VR”)environment is an interactive, virtual, digital, or otherwise computergenerated three-dimensional environment or simulation. An augmentedreality (“AR”) environment may be considered a form of virtual realitythat layers virtual information over a camera feed into an HMD unit 102or through a smartphone or tablet or other device coupled to the HMDunit 102 giving the user the ability to view three-dimensional images.

In one embodiment, the HMD unit 102 is coupled to a headband 104 that isconfigured to go over/around the user's head and hold the HMD unit 102against the user's eyes/face. As shown in FIG. 1, the headband 104 mayencompass the user's head using different bands. In certain embodiments,a single headband 104 that goes around the user's head may be used, orother bands that go over the user's head may be used to add additionalsupport for the HMD unit 102. Other embodiments may include arms,similar to arms for eyeglasses, that sit on the user's ears, a chinstrap for securing the HMD unit 102 to the user's head, a helmet thattotally encloses the user's head, a visor, and/or the like.

In one embodiment, the headband 104 includes one or more sensors 106that are used to sense, collect, detect, and/or the like informationfrom different locations on the user's head such as the user's scalp,forehead, face, ears, neck, and/or the like. In certain embodiments, thesensors 106 comprise electrode probes that are communicatively and/oroperatively coupled to the HMD display 102 via electrical lines, cables,wires, or the like that are embedded in the headband 104. For instance,the HMD unit 102 may comprise a signal generator or other power sourcethat is used to activate the electrode probes, and the electrode probesmay send signals, data, information, or the like that is sensed from theuser's head to the HMD unit 102. The electrode probes may comprise “dry”probes that do not require a gel or other viscous agent to be applied tothe user's head to sense, detect, or capture a signal from the user'shead.

In certain embodiments, the electrodes are used to captureelectroencephalography (“EEG”) data sensed from one or more locations onthe user's head. As used herein, EEG may refer to anelectrophysiological monitoring method to record electrical activity ofthe brain. As shown in the electrode map 120 illustrated in FIG. 1B,electrode probes may be placed at predefined locations 120 on the user'shead 122 depending on the parts of the brain that are of interest tomeasure.

For instance, in one embodiment described below, the electrode probesmay be placed in the headband 104 such that the electrode probes arepositioned over locations FP1 124 a, FP2 124 b, TP9 124 c, and TP10 124d (collectively 124) on the user's head 122 (scalp) to measure thecognition level of the user. As used herein, a user's cognition levelmay refer to the user's current ability to process data, acquireknowledge, perceive surroundings, maintain attention, or the like. Inother words, the user's cognition may encompass may aspects ofintellectual functions and processes such as attention, the formation ofknowledge, memory and working memory, judgment and evaluation, reasoningand “computation”, problem solving and decision making, comprehensionand production of language.

Similarly, the electrode probes may be placed in the headband 104 suchthat the electrode probes are positioned over locations O1 126 a, O2 126b, Oz 126 c, and Iz 126 d (e.g., the back of the head) (collectively124) on the user's head 122 (scalp) to measure the visual acuity of theuser. As used herein, visual acuity may refer to the clarity of theuser's vision, which may be detected, estimated, determined, or the likebased on measuring brain activity using electrode probes at theforegoing locations on the user's head 122.

In one embodiment, the display adjustment apparatus 108 is configured todetermine the user's cognitive level and/or the user's visual acuitybased on the data that is sensed using the one or more sensors 106 thatare located on the user's head 122, and dynamically adjust one or moredisplay settings for the HMD unit 102 to enhance or reduce the user'scognitive level, correct or enhance the user's visual acuity, and/or thelike, as described in more detail below. For instance, the displayadjustment apparatus 108 may automatically adjust the display of variousaugment reality overlay elements to help the user focus or to draw theuser's focus on to display. In various embodiments, the displayadjustment apparatus 108 may be embodied as a hardware appliance thatcan be installed or deployed on/in an HMD unit 102.

The display adjustment apparatus 108, in such an embodiment, may includea semiconductor integrated circuit device (e.g., one or more chips, die,or other discrete logic hardware), or the like, such as afield-programmable gate array (“FPGA”) or other programmable logic,firmware for an FPGA or other programmable logic, microcode forexecution on a microcontroller, an application-specific integratedcircuit (“ASIC”), a processor, a processor core, or the like. In oneembodiment, the display adjustment apparatus 108 may be mounted on aprinted circuit board with one or more electrical lines or connections(e.g., to volatile memory, a non-volatile storage medium, a networkinterface, a peripheral device, a graphical/display interface, or thelike). The hardware appliance may include one or more pins, pads, orother electrical connections configured to send and receive data (e.g.,in communication with one or more electrical lines of a printed circuitboard or the like), and one or more hardware circuits and/or otherelectrical circuits configured to perform various functions of thedisplay adjustment apparatus 108.

The semiconductor integrated circuit device or other hardware applianceof the display adjustment apparatus 108, in certain embodiments,includes and/or is communicatively coupled to one or more volatilememory media, which may include but is not limited to random accessmemory (“RAM”), dynamic RAM (“DRAM”), cache, or the like. In oneembodiment, the semiconductor integrated circuit device or otherhardware appliance of the display adjustment apparatus 108 includesand/or is communicatively coupled to one or more non-volatile memorymedia, which may include but is not limited to: NAND flash memory, NORflash memory, nano random access memory (nano RAM or NRAM), nanocrystalwire-based memory, silicon-oxide based sub-10 nanometer process memory,graphene memory, Silicon-Oxide-Nitride-Oxide-Silicon (“SONOS”),resistive RAM (“RRAM”), programmable metallization cell (“PMC”),conductive-bridging RAM (“CBRAM”), magneto-resistive RAM (“MRAM”),dynamic RAM (“DRAM”), phase change RAM (“PRAM” or “PCM”), magneticstorage media (e.g., hard disk, tape), optical storage media, or thelike.

FIG. 2 is a schematic block diagram illustrating one embodiment of anapparatus 200 for adjusting display settings of a head-mounted display.In one embodiment, the apparatus 200 includes an instance of a displayadjustment apparatus 108. In certain embodiments, the display adjustmentapparatus 108 includes one or more of a sensor module 202, a cognitionmodule 204, a vision module 206, and an adjustment module 208, which aredescribed in more detail below.

The sensor module 202, in one embodiment, is configured to receivesensor data from one or more sensors 106 operably connected to an HMDunit 102 while a user wears the HMD unit 102. As described above, thesensors 106 may comprise electrode probes that are integrated into theheadband 104 that is used to wear the HMD unit 102. The sensor data, incertain embodiments, includes EEG data that describes brain activity atthe various locations where the sensors 106 are located on the user'shead 122.

In one embodiment, as it relates to determining the user's cognitionlevel, the EEG data comprises a measurement or quantified value of asignal strength that the one or more sensors 106 detect or sense (e.g.,that an electrode probe measures) at the predetermined locations 124 onthe user's head 122 associated with cognition within the beta-wavefrequency range or band, which is typically in the 12-30 Hertz range.

In further embodiments, as it relates to determining the user's visualacuity, the EEG data comprises a measurement or quantified value of asignal strength that the one or more sensors 106 detect or sense (e.g.,that an electrode probe measures) at the predetermined locations 126 onthe user's head 122 associated with visual acuity within the theta- andalpha-wave frequency ranges or bands, which are typically in the 4-7.5Hertz and the 8-10 Hertz ranges, respectively.

In one embodiment, the cognition module 204 is configured to determinethe user's cognition level based on the sensor data. For instance, thecognition module 204 may determine whether the beta-wave frequency datasatisfies a threshold value associated with a predefined cognitionlevel, is within a frequency range or band associated with a predefinedcognition level, and/or the like. In such an embodiment, the cognitionmodule 204 performs a time-frequency or wavelet transform on the EEGdata that the sensors 106 sense, and the amplitude of the transform inthe beta-band frequency range (16-31 Hertz) is measured to determine theuser's cognition level over time.

In one embodiment, the threshold value may be a predefined and/ordefault value, a value determined based on other characteristics of theuser (e.g., the user's age, weight, heart rate, blood pressure, and/orother biometric information), a value determined as the result of asurvey, quiz, or other subjective information, a value determined as aresult of a calibration test, and/or the like. For instance, thecognition module 204 may take initial EEG readings based on informationpresented on the display that is intended to activate different parts ofthe user's brain associated with the user's cognition level, acquirebiometric data, and/or gather subjective data from a user in the form ofa survey or health questions to set a benchmark, and correspondingthresholds based on the benchmark, for the user's cognition level.

For example, if the power (e.g., EEG data) that is measured andcalculated in a beta-wave frequency band is too high (exceeds a powerthreshold calculated in the beta-wave band or is within a powerthreshold range calculated in the beta-wave band), e.g., between 24 and30 Hertz, then the cognition module 204 may determine that the user isexperiencing high levels of adrenaline, anxiety, arousal, inability torelax, stress, or the like, and therefore may not be able to focus onwhat he/she is doing because the user is too “worked up” or “excited”.

Similarly, if the power that is measured and calculated in the beta-wavefrequency band is too low (is less than a power threshold calculated inthe beta-wave band or is within a power threshold range calculated inthe beta-wave band), e.g., between 12 and 18 Hertz, then the cognitionmodule 204 may determine that the user is experiencing fatigue,daydreaming, depression, sleepiness, boredom, or the like. Accordingly,the optimal beta-wave frequency band or range for the user may besomewhere between the lower and higher ranges, e.g., 18-24 Hertz, whichmay indicate that the user is able to focus, learn, retain memories,problem solve, or the like. Based on the values of the power that ismeasured and calculated in the beta-wave frequency band, the adjustmentmodule 208, described below, can determine how to adjust the displaysettings of the HMD unit 102 to help the user focus.

In one embodiment, the vision module 206 is configured to determine theuser's visual acuity based on the sensor data. For instance, the visionmodule 206 may determine whether the theta- and alpha-wave frequencydata satisfies a threshold value associated with a predefined visualacuity, is within a frequency range or band associated with a predefinedvisual acuity, and/or the like. In such an embodiment, the cognitionmodule 204 performs a time-frequency or wavelet transform on the EEGdata that the sensors 106 sense, and the amplitude of the transform inthe theta-band frequency range (4-7.5 Hertz) and the alpha-bandfrequency range (8-10 Hertz) is measured to determine the user's visualacuity over time. These two bands, the alpha- and theta-wave bands, mayrelate to visual cortex activity with prominent spectral power meanchanges within the theta-wave 5.73-6.22 Hertz frequency range.

In one embodiment, the threshold value may be a predefined and/ordefault value, a value determined based on other characteristics of theuser (e.g., the user's age, weight, heart rate, blood pressure, and/orother biometric information), a value determined as the result of asurvey, quiz, or other subjective information, a value determined as aresult of an eye-exam presented on the display, a value determined as aresult of a calibration test, and/or the like. For instance, the visionmodule 206 may take initial EEG readings based on information presentedon the display that is intended to activate different parts of theuser's brain associated with the user's visual acuity, acquire biometricdata, and/or gather subjective data from a user in the form of a surveyor health questions to set a benchmark, and corresponding thresholdsbased on the benchmark, for the user's visual acuity.

For example, if the power (e.g., EEG data) that is measured andcalculated in the theta-wave frequency band is too high (exceeds a powerthreshold calculated in the theta-wave band or is within a powerthreshold range calculated in the theta-wave band), e.g., around 7.5Hertz, or too low (less than a power threshold calculated in thetheta-wave band or is within a power threshold range calculated in thetheta-wave band), e.g., around 4 Hertz, and/or the power that ismeasured and calculated in the alpha-wave frequency band is too high(exceeds a power threshold calculated in the alpha-wave band or iswithin a power threshold range calculated in the alpha-wave band), e.g.,around 10 Hertz, or too low (is less than a power threshold calculatedin the alpha-wave band or is within a power threshold range calculatedin the alpha-wave band), e.g., around 8 Hertz, then the vision module206 may determine, based on the user's brain activity, that the user'svision is impaired or the user is otherwise having a difficult timefocusing his/her vision, and therefore may not be able to focus on whathe/she is doing. Based on the values of the power that is measured andcalculated in the theta- and alpha-wave frequency bands, the adjustmentmodule 208, described below, can determine how to adjust the displaysettings of the HMD unit 102 to correct for the user's visionimpairment, fatigue, or the like.

In one embodiment, the adjustment module 208 is configured to adjust oneor more display settings for the HMD unit 102 based on the determinedcognition level for the user. For instance, in one embodiment, adjustingone or more display settings of the HMD unit 102 may include changingone or more settings of the VR and/or AR environments to help the userachieve an optimal cognition level for focusing (e.g., to calm or relaxthe user or to excite or “wake up” the user). For example, theadjustment module 208 may adjust a brightness setting of AR/VR graphicalelements presented on the display (to make the graphical elementsbrighter or dimmer), a contrast setting of the display between AR/VRgraphical elements presented on the display and an actual background (tomake the graphical elements stand-out more or less), a color setting ofgraphical elements presented on the display (to make graphical elementsappear with brighter, more noticeable colors, or duller, less noticeablecolors), a size of graphical elements presented on the display (to makethe graphical items appear larger or smaller), and/or the like.

In one embodiment, the adjustment module 208 is configured to adjust oneor more display settings for the HMD unit 102 based on the determinedvisual acuity for the user. For instance, in one embodiment, adjustingone or more display settings of the HMD unit 102 may include changingone or more settings of the VR and/or AR environments to correct for theuser's impaired vision (e.g., to correct for blurry vision, astigmatism,near-sightedness or far-sightedness, or the like). For example, theadjustment module 208 may adjust a resolution of the display, a pixeldensity of the display, and/or a zoom setting of the display (to makegraphical elements appear sharper, larger, smaller, or the like); acontrast setting of the display between AR/VR graphical elementspresented on the display and an actual background (to make the graphicalelements stand-out more or less, to make the graphical elements appearsharper or less blurry); a color setting of graphical elements presentedon the display (to make graphical elements appear with brighter, morenoticeable colors, or duller, less noticeable colors); a size ofgraphical elements presented on the display (to make the graphical itemsappear larger or smaller); a font size of text on the display (to makeit easier to read); and/or the like.

In this manner, the display adjustment apparatus 108 can dynamicallyadjust various display settings of an HMD unit 102 based on detecting,reading, and interpreting brain activity of the user to assist with theuser's cognition level and/or visual acuity.

FIG. 3 is a schematic block diagram illustrating one embodiment ofanother apparatus 300 for adjusting display settings of a head-mounteddisplay. In one embodiment, the apparatus 300 includes an instance of adisplay adjustment apparatus 108. In certain embodiments, the displayadjustment apparatus 108 includes one or more of a sensor module 202, acognition module 204, a vision module 206, and an adjustment module 208,which may be substantially similar to the sensor module 202, thecognition module 204, the vision module 206, and the adjustment module208 described above with reference to FIG. 2. In further embodiments,the display adjustment apparatus 108 includes one or more of amonitoring module 302, a notification module 304, a baseline module 306,and a biometric module 308, which are described in more detail below.

In one embodiment, the monitoring module 302 is configured to monitor,over time, the user's cognition level and/or visual acuity based on newsensor data from the one or more sensors 106 while the user wears theHMD unit 102. For instance, the monitoring module 302 may periodicallypoll, check, request, or the like sensor data from the sensors 106,e.g., every thirty seconds. In certain embodiments, the sensors 106 maybe configured to sample and send sensor data on a periodic basis, e.g.,every thirty seconds. Based on the new sensor data, the cognition module204 may determine the user's current cognition level and/or the visionmodule 206 may determine the user's current visual acuity, and theadjustment module 208 may adjust the display settings accordingly.

In one embodiment, the notification module 304 is configured to notifythe user that the one or more sensors 106 are not positioned in acorrect location on the user's head 122 in response to not receivingsensor data from one or more of the sensors 106. For instance, if thenotification module 304 detects that a sensor 106 is not reading orreturning any EEG data, or that the sensor is returning incorrect orgarbage data, the notification module 304 may display a notification onthe display of the HMD unit 102, may provide an audio notification, orthe like indicating that the headband 104 and/or sensors 106 need to beadjusted so that accurate data readings can be acquired.

In one embodiment, the baseline module 306 is configured to generate abaseline of sensor data for a period of time after the HMD unit 102 isactivated prior to determining the user's cognition level and/or visualacuity and adjusting the one or more display settings of the HMD unit102. In certain embodiments, the baseline module 306 may run acalibration program/application to determine whether the sensors arecollecting data, are gathering reliable data, and/or to acclimate theuser to the HMD unit 102. The calibration process may include anapplication, process, or program designed to test, activate, or the likethe various areas of the brain that are associated with the user'scognition level and/or visual acuity.

Once the HMD unit 102 is up and running, and the user is running anapplication and workload for a period of time (e.g., five minutes, tenminutes, or the like) to give the user's brain a chance to stabilize orreach a steady state, the cognition module 204 may determine the user'scognition level and/or the vision module 206 may determine the visualacuity of the user after the baseline data set is established.Accordingly, the adjustment module 208 may adjust various displaysettings based on the user's cognition level or visual acuity.

In one embodiment, the biometric module 308 is configured to acquirebiometric data for the user to further determine or verify the user'scognition level and/or visual acuity as determined based on the sensordata from the sensors 106 in the HMD unit 102 headband 104. Thebiometric data may be acquired from a wearable device such as a smartwatch, a fitness band, biometric sensors on the HMD unit 102 or headband104, and/or the like.

For instance, the biometric module 308 may use biometric data todetermine a skin conductivity for the user, a heart rate for the user, ablood pressure for the user, and/or an oxygen level for the user, whichmay be used to verify or supplement the cognition level for the userthat is determined using the sensors 106 in the headband 104. Forexample, if the cognition module 204 determines that the user is excitedbased on the beta-wave frequency EEG data, the biometric module 308 mayverify this conclusion based on determining that the user has aheightened breathing rate, adrenaline level, heart rate, and/or thelike.

Similarly, the biometric module 308 may use biometric data from an in-or on-ear device, e.g., a Bluetooth® headset, to determine or verify theuser's visual acuity. In certain embodiments EEG or other sensors may beplaced in or on the ear to sense, sample, or capture brain or headactivity associated with the user's visual acuity, which may be used tosupplement or verify the conclusion that the vision module 206 reachesregarding the user's visual acuity based on the theta- and alpha-wavefrequency EEG data captured by the sensors 106 in the headband 104.Other biometric data may be collected that is associated with orotherwise provides an indication of the user's visual acuity such as,for example, blood pressure, heart rate, oxygen levels, adrenalinelevels, breathing rate, and/or the like, which may be sensed using oneor more sensors 106 of the HMD unit 102, using sensors on wearabledevices such as fitness bands, smart watches, and/or the like.

FIG. 4 is a schematic flow chart diagram illustrating one embodiment ofa method 400 for adjusting display settings of a head-mounted display.In one embodiment, the method 400 begins and receives 402 sensor datafrom one or more sensors 106 operably connected to an HMD unit 102 whilea user wears the HMD unit 102. In some embodiments, the method 400determines 404 a user's cognition level based on the sensor data. Infurther embodiments, the method 400 adjusts 406 one or more displaysettings of the HMD unit based on the determined cognition level for theuser, and the method 400 ends. In some embodiments, the sensor module202, the cognition module 204, and the adjustment module 208 perform thevarious steps of the method 400.

FIG. 5 is a schematic flow chart diagram illustrating one embodiment ofanother method 500 for adjusting display settings of a head-mounteddisplay. In one embodiment, the method 500 begins and checks 502 thesensors 106 to determine 504 whether the sensors 106 are responding,reading data, reading accurate data, and/or the like. If the method 500,in one embodiment, determines 504 that the sensors are not respondingcorrectly, the method 500 notifies 506 the user to adjust the headband104 and/or sensors 106.

In one embodiment, the method 500 receives 508 sensor data from thesensors 106 while the user wears the HMD unit 102. The method 500 maydetermine 510 whether this is the first time that the user has worn theHMD unit 102, if the user just activated the HMD unit 102, or the like.If so, then the method 500, in certain embodiments, generates 512 abaseline of sensor data for a period of time after the HMD unit 102 isactivated prior to determining the user's cognition level and adjustingthe one or more display settings of the HMD unit 102.

If the method 500, in certain embodiments, determines 514 that thebaseline data is sufficient, e.g., after a period of time, after theworkload running on the HMD unit 102 and/or the sensor data has reacheda steady state, after completing a calibration process, or the like, themethod 500 determines 516 the user's cognition level based on the sensordata, e.g., based on the beta-wave frequency data and adjusts 518 thedisplay settings of the HMD unit 102 accordingly. The method 500, incertain embodiments, continues to receive 508 sensor data, monitor theuser's cognition level, and adjust the display settings of the HMD unit102. In some embodiments, the sensor module 202, the cognition module204, the adjustment module 208, the monitoring module 302, thenotification module 304, and the baseline module 306 perform the varioussteps of the method 500.

FIG. 6 is a schematic flow chart diagram illustrating one embodiment ofa method 600 for adjusting display settings of a head-mounted display.In one embodiment, the method 600 begins and receives 602 sensor datafrom one or more sensors 106 operably connected to an HMD unit 102 whilea user wears the HMD unit 102. In some embodiments, the method 600determines 604 a user's visual acuity based on the sensor data. Infurther embodiments, the method 600 adjusts 606 one or more displaysettings of the HMD unit based on the determined visual acuity for theuser to correct impairments in the user's visual acuity, and the method600 ends. In some embodiments, the sensor module 202, the vision module206, and the adjustment module 208 perform the various steps of themethod 600.

FIG. 7 is a schematic flow chart diagram illustrating one embodiment ofanother method 700 for adjusting display settings of a head-mounteddisplay. In one embodiment, the method 700 begins and checks 702 thesensors 106 to determine 704 whether the sensors 106 are responding,reading data, reading accurate data, and/or the like. If the method 700,in one embodiment, determines 704 that the sensors are not respondingcorrectly, the method 700 notifies 706 the user to adjust the headband104 and/or sensors 106.

In one embodiment, the method 700 receives 708 sensor data from thesensors 106 while the user wears the HMD unit 102. The method 700 maydetermine 710 whether this is the first time that the user has worn theHMD unit 102, if the user just activated the HMD unit 102, or the like.If so, then the method 700, in certain embodiments, generates 712 abaseline of sensor data for a period of time after the HMD unit 102 isactivated prior to determining the user's visual acuity and adjustingthe one or more display settings of the HMD unit 102.

If the method 700, in certain embodiments, determines 714 that thebaseline data is sufficient, e.g., after a period of time, after theworkload running on the HMD unit 102 and/or the sensor data has reacheda steady state, after completing a calibration process, or the like, themethod 700 determines 716 the user's visual acuity based on the sensordata, e.g., based on the theta- and alpha-wave frequency data andadjusts 718 the display settings of the HMD unit 102 accordingly. Themethod 700, in certain embodiments, continues to receive 708 sensordata, monitor the user's visual acuity, and adjust the display settingsof the HMD unit 102. In some embodiments, the sensor module 202, thevision module 206, the adjustment module 208, the monitoring module 302,the notification module 304, and the baseline module 306 perform thevarious steps of the method 700.

Embodiments may be practiced in other specific forms. The describedembodiments are to be considered in all respects only as illustrativeand not restrictive. The scope of the invention is, therefore, indicatedby the appended claims rather than by the foregoing description. Allchanges which come within the meaning and range of equivalency of theclaims are to be embraced within their scope.

What is claimed is:
 1. An apparatus, comprising: a processor; a memorythat stores code executable by the processor to: receive sensor datafrom one or more sensors operably connected to a head mounted display(“HMD”) unit while a user wears the HMD unit, the one or more sensorscomprising electroencephalography (“EEG”) sensors for capturing brainactivity data at various locations on the user's head; execute acalibration program to generate a baseline of EEG data for a period oftime after the HMD unit is activated, the calibration program configuredto activate different areas of the user's brain using the EEG sensors;determine a visual acuity of the user based on the sensor data inresponse to the baseline EEG data indicating that the user's brain hasreached a steady state, the visual acuity indicated by the sensor datarelative to a threshold, the threshold comprising a value that isassociated with a predefined visual acuity; and adjust one or moresettings of a display of the HMD unit that has an effect on the user'svisual acuity based on the determined visual acuity for the user, theone or more display settings adjusted to correct for impairments in theuser's visual acuity.
 2. The apparatus of claim 1, wherein the sensordata is sensed from one or more locations on the user's head, the one ormore sensors coupled to a headband that is connected to the HMD unit. 3.The apparatus of claim 1, wherein the EEG data comprises a measurementof a signal strength that the one or more sensors sense within thealpha- and theta-wave ranges, the user's visual acuity determinedaccording to the measured signal strength.
 4. The apparatus of claim 2,wherein the one or more sensors comprise one or more electrode probesand the one or more locations on the user's head where the sensors arelocated is selected from the group consisting of a back of the user'shead, O1, O2, and OZ locations.
 5. The apparatus of claim 1, wherein thecode is further executable by the processor to: monitor, over time, theuser's visual acuity based on new sensor data from the one or moresensors while the user wears the HMD unit; and further adjust the one ormore display settings of the HMD unit based on the user's visual acuity.6. The apparatus of claim 1, wherein the code is further executable bythe processor to notify the user that the one or more sensors are notpositioned in a correct location on the user's head in response to notreceiving sensor data from one or more of the sensors.
 7. The apparatusof claim 1, wherein the code is further executable by the processor toacquire biometric data for the user, the biometric data further used todetermine the user's visual acuity.
 8. The apparatus of claim 7, whereinthe biometric data is captured using a sensor placed one or more of inand on the user's ear.
 9. The apparatus of claim 1, wherein the code isexecutable by the processor to present one or more of an augmentedreality (“AR”) environment and a virtual reality (“VR”) environment on adisplay of the HMD unit.
 10. The apparatus of claim 9, wherein adjustingone or more settings of the HMD unit comprises changing one or moresettings of the VR and AR environment, the one or more settings selectedfrom the group consisting of a resolution of the display, a pixeldensity of the display, a contrast setting of the display betweenelements presented on the display and an actual background, a zoomsetting, a color setting, and a font setting.
 11. A system, comprising:a head-mounted display (“HMD”) unit comprising a processor and a memorythat stores code executable by the processor; a headband coupled to theHMD unit; and one or more sensors coupled to the headband and operablyconnected to the HMD unit, wherein the code is executable by theprocessor to: receive sensor data from one or more sensors operablyconnected to a head mounted display (“HMD”) unit while a user wears theHMD unit, the one or more sensors comprising electroencephalography(“EEG”) sensors for capturing brain activity data at various locationson the user's head; execute a calibration program to generate a baselineof EEG data for a period of time after the HMD unit is activated, thecalibration program configured to activate different areas of the user'sbrain using the EEG sensors; determine a visual acuity of the user basedon the sensor data in response to the baseline EEG data indicating thatthe user's brain has reached a steady state, the visual acuity indicatedby the sensor data relative to a threshold, the threshold comprising avalue that is associated with a predefined visual acuity; and adjust oneor more settings of a display of the HMD unit that has an effect on theuser's visual acuity based on the determined visual acuity for the user,the one or more display settings adjusted to correct for impairments inthe user's visual acuity.
 12. The system of claim 11, wherein the one ormore sensors comprise one or more electrode probes positioned at one ormore locations on the user's head, the one or more locations selectedfrom the group consisting of a back of the user's head, O1, O2, and OZlocations.
 13. The system of claim 11, wherein the code is executable bythe processor to present one or more of an augmented reality (“AR”)environment and a virtual reality (“VR”) environment on a display of theHMD unit, the one or more settings of the VR and AR environment that areadjusted are selected from the group consisting of a resolution of thedisplay, a pixel density of the display, a contrast setting of thedisplay between elements presented on the display and an actualbackground, a zoom setting, a color setting, and a font setting.
 14. Amethod, comprising: receiving, by a processor, sensor data from one ormore sensors operably connected to a head mounted display (“HMD”) unitwhile a user wears the HMD unit, the one or more sensors comprisingelectroencephalography (“EEG”) sensors for capturing brain activity dataat various locations on the user's head; executing a calibration programto generate a baseline of EEG data for a period of time after the HMDunit is activated, the calibration program configured to activatedifferent areas of the user's brain using the EEG sensors; determining avisual acuity of the user based on the sensor data in response to thebaseline EEG data indicating that the user's brain has reached a steadystate, the visual acuity indicated by the sensor data relative to athreshold, the threshold comprising a value that is associated with apredefined visual acuity; and adjusting one or more settings of adisplay of the HMD unit that has an effect on the user's visual acuitybased on the determined visual acuity for the user, the one or moredisplay settings adjusted to correct for impairments in the user'svisual acuity.
 15. The method of claim 14, further comprising:monitoring, over time, the user's visual acuity based on new sensor datafrom the one or more sensors while the user wears the HMD unit; andfurther adjusting the one or more display settings of the HMD unit basedon the user's visual acuity.
 16. The method of claim 14, furthercomprising notifying the user that the one or more sensors are notpositioned in a correct location on the user's head in response to notreceiving sensor data from the one or more sensors.
 17. The method ofclaim 14, further comprising generating a baseline of sensor data for aperiod of time after the HMD unit is activated prior to determining theuser's visual acuity and adjusting the one or more display settings ofthe HMD unit.